Typeset with jpsj2.cls <ver.l.2.1> 



Letter 



Markovian Approximation for the Nose— Hoover method and H-theorem 

Hiroshi WATANABE* 

Department of Complex Systems Science, Graduate School of Information Science, Nagoya University 

A Langevin equation with state-dependent random force is considered. When the 
Helmholtz free energy is a nonincreasing function of time (the H-theorem), a generalized 
Einstein relation is obtained. A stochastic process of the Nose-Hoover method is discussed 
on the basis of the Markovian approximation. It is found that the generalized Einstein re- 
lation holds for the Fokker-Planck equation associated with the stochastic Nose-Hoover 
equation. The present result indicates that the Nose-Hoover dynamics coarse-grained with 
time satisfies the H-theorem and therefore works as a heat bath. 
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The purpose of the present study is to investigate the entropy production of the system, the 
temperature of which controlled by the Nose-Hoover method. The equations of motion of the 
Nose-Hoover method contain friction terms with memory effects. 1-4 ^ These equations are time- 
reversible and the distribution function of the system does not change with time, providing 
that the system is ergodic. A system driven by the Nose-Hoover method, therefore, does 
not exhibit relaxation from the microscopic viewpoint, i.e., there is no entropy production. 
However, if one observes macroscopic quantities, such as the temperature of the system, it 
exhibits relaxation to the values in the equilibrium state. This implies that the thermostated 
system is time- irreversible and exhibits entropy production from the macroscopic viewpoint. 

This phenomenon, time-reversible from the microscopic viewpoint and time-irreversible 
from the macroscopic viewpoint, has been considered in the theory of generalized Brown- 
ian motions. 5 ^ Mori derived the so-called Mori equation from Hamilton's equation by the 
projection-operator method. 6 ** The Mori equation describes the time evolution of macroscopic 
variables, which are the functions of microscopic variables. While the Mori equation exhibits 
time reversibility, the generalized Langevin equation derived from the Mori equation is time- 
irreversible because of the Markovian approximation. Zwanzig derived the explicit and exact 
form of the Langevin equation from the microscopic dynamics of the system interacting with 
many harmonic oscillators. 7 ) This formulation clearly shows how the system loses its time 
reversibility with the Markovian approximation. 

The above studies consider the stochastic process of the macroscopic variables driven 
by the deterministic dynamics of the microscopic variables. Thus, a similar analysis may be 
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possible for the system with a thermostat. The projection, i.e., the elimination of the degrees 
of freedom, and Markovian approximation lead to the stochastic process of the thermostated 
system, which enables us to study the entropy production of the system with the Nose-Hoover 
method or other thermostats. 

In the present article, we first consider the generalized Langevin equation with state- 
dependent random force. We derive the extended Einstein relation by considering the mono- 
tonic decay of the free energy, i.e., the H-theorem. Then, we discuss the stochastic process 
of the system with the Nose-Hoover method by the Markovian approximation, and we show 
that the equation of motion with coarse graining is a special case of the generalized Langevin 
equation with state-dependent random force. A comparison with the traditional Brownian 
motion theory is also given. 

We start from the following equations of motion, 

dH 

dp ' 

with a Hamiltonian H{p, q) and a thermostating term f. Throughout this manuscript, stochas- 
tic variables are denoted by a hat, and we consider the system with one-degree of freedom for 
simplicity. For the system to exhibit a stable and steady state, the thermostating term should 
contain two parts, namely, a friction term and a diffusion term. Here, we take the form of the 
term r to be 

r(p,t) = h(p)+g(p)R(t), (2) 

where h(p) denotes the friction term and g(p)R(t) denotes the state-dependent diffusion term 
with the noise R. We assume that the noise R is Gaussian, the autocorrelation function of 
which is given by 

E(R(t)R(t')) = 2DS(t-t'), (3) 

where E(X) denotes the expected value of the random variable X and D{> 0) denotes the 
amplitude of the noise. The Fokker-Planck equation corresponding to the equations of motion 
(ffl) is 

where / denotes the distribution function, curly brackets denote Poisson brackets and J p is 
the probability flux corresponding to the thermostating term. The flux J p is defined as 

J P = E(rf). (5) 
Since the noise R is assumed to be Gaussian, the flux is expressed as 

Jp = ( h ~ D %s]f, (6) 
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with g' = dg/dp. 

The Helmholtz free energy of this system is defined as 



F(t) = J f{H + (3- 1 \nf)dpdq, 



(8) 



with the inverse temperature (3. If the system is isolated, the H-theorem must hold, i.e., the 
free energy should be a nonincreasing function of time as 

dF 



dt 



< 0. 



The derivative of the free energy with respect to time is 

dF 
dF 



/^(ff + /3- 1 ln/+l)dpd 9! 
-/^(^ + r 1 ln/)dpdg, 

J f \ dp dp) 



(9) 

(10) 

(11) 
(12) 



Here, we use the conservation of probability 

dj_ 
dt 



dpdq = 0, 



and the integration by parts is applied with respect to p. For the H-theorem to hold, the 
integrand of Eq. (|12p must always be nonpositive as 



f Jp (fdp^ + dp) 



Comparing Eqs. (JTJ) and (fT3|) . we obtain 



Dg< 



+ 



P 



dH 

dp ' 



or equivalently, 



,dH 



D(3g 1 —+Dgg'. 
dp 



(13) 



(14) 



(15) 



The above equation describes the relationship between the friction term and the diffusion term. 
This includes the Einstein relation as the special case when g is constant. Equation (|15p is, 
therefore, one of the expressions of the fluctuation-dissipation theorem. Inserting the obtained 
expressions for h into the equation of motion (pQ), we obtain the generalized Langevin equation, 



dH 



P 
Q 



dq 
dH 

dp ' 



dH 



— - gl [3Dg— -Dg'-R 



dp 



(16) 



which always satisfies the H-theorem for an arbitrary function g(p). Note that the equation of 
motion (I16p is not invariant for time-reversal operation, since the friction term h(p) changes 
its sign for time-reversal operation, while p does not. Equation (|16p is, therefore, always time- 
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irreversible. The Fokker-Planck equation corresponding to Eq. (|16|) is given by 



9f _ m n+ d 



Dg 2 



p d —f+ d -± 
dp dp 



(17) 



One can confirm that the Gibbs canonical distribution / oc exp(—f3H) can be achieved when 
the system reaches the steady state, i.e., df jdt = 0. 

Next, we consider the relationship between the H-theorem and a thermostated system 
with coarse graining. Consider the system described by the Hamiltonian H (p, q) with the 
Nose-Hoover thermostat. The equations of motion of this system are 

dH 



P 



dq 
dH 

~d~ 
H 



(18) 



C = p-r — o> 



1 

dp (5' 

with an additional degree of freedom £. Note that the relaxation time of the thermostat is set 
to be unity and the general form of Hamiltonian is considered. 8 - 1 These equations of motion 
satisfy the continuum equation, 



0. 



for the canonical distribution 



fip, Q, = Z 1 exp(-/Jflex), 



(19) 



(20) 



with the extended Hamiltonian H cx 
the canonical distribution invariant. 
We can eliminate £ formally as 

V = 



where 



H + £ 2 /2. Therefore, the Nose-Hoover equation keeps 



dH 

dp ' 



G{t)=P ^p--p- 



(21) 



(22) 



Equation (|21|) has the form of the Langevin equation with the friction term exhibiting a mem- 
ory effect. The time evolution is time-reversible and non-Markovian because of this memory 
effect. In the following, we shall derive a stochastic-Nose-Hoover equation by applying the 
Markovian approximation to the friction term. G(t) varies more slowly than p in the many- 
body system and should fluctuate around zero, since 



dH \ _ 1 



(23) 



dp I /3 

where angular brackets denote the average over the canonical ensemble. Assuming that G(t) 
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is not correlated to time longer than r, we can approximate the integration in Eq. (I2ip as 

f G(s)ds ~ T G{t) + R(t), (24) 
Jo 

with the Gaussian noise R defined in Eq. ([3]). Inserting Eq. (|24p to Eq. (|21[) . we obtain the 
stochastic-Nose-Hoover equation as 



dH ( dH t - 
P = — x P T~p— — + R 



dq \ dp f3 
dH 



(25) 



dp 

The characteristic time scale r should be a function of the inverse temperature (3 and noise 
amplitude D, and therefore, we can assume the Einstein relation r = \/((3D). Thus, the 
Fokker-Planck equation corresponding to Eq. (|25l) is given by 



P ( o dH * d f 



(26) 



f3 2 D \ dp dp / 

This equation is the special case of Eq. (fT7|) with g(p) = pj ((3D); therefore, the free energy of 
this system decays monotonically and the canonical distribution / ~ exp(-PH) is achieved 
when the system reaches the steady state. 

The elimination of the additional variable £ can be considered as the projection from the 
phase space (p,q,() to its subspace (p,q). Equation ([2Tj) corresponds to the Mori equation 
that is time-reversible and contains the memory effect. The Markovian approximation breaks 
time reversibility explicitly, as shown in Eq. (124p . since the left-hand side changes its sign for 
time-reversal operation, while the right-hand side does not. This shows how the thermostated 
system loses its time reversibility with the Markovian approximation. It is worth noting that 
the Markovian approximation applied in Eq. (|24p is justified only in the system with many 
degrees of freedom, while we have shown the derivation of a single degree of freedom. 

To summarize, a generalized Langevin equation with state-dependent random force is 
derived when the H-theorem holds in the system. The Nose-Hoover method coarse-grained 
with time satisfies the H-theorem, and therefore, works as a heat bath. 

We have studied the multiplicative noise in order to consider the generalized Langevin 
equation that includes the stochastic-Nose-Hoover equation. Recently, a Langevin equation 
with a random multiplicative noise has been studied. 9 ) This study shows that the process 
exhibits Tsallis statistics and the H-theorem is satisfied in this system. Moreover, a determin- 
istic thermostat, which achieves a Tsallis distribution as a result of time evolution, has been 
proposed. 10 ^ Therefore, it is interesting to note that this is one of the issues that must be 
further investigated to study the entropy production of a system with general thermostats in 
a manner similar to that presented in this article. 
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